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GROUND TRAINING DEVICES IN JOB SAMPLE 
APPROACtrjO UPT SELECtlQ ;AND SCREENING 

i, INTROpUCnON J 

statement pfjhc Problem • ; « 

Jh?. purpose: of ih^ study was to investigate the. use of thCtA/F 37A-T40 Instrument Traincr as an 
efTectiye^selec^ion dcvi^^ for early identification of critical flyiiig a69ities possessed by uhdci^aduate pilot 
- training (Urt) candif^^^ ^ , , * , ' " 

JlTicstudylhaAt^^^ ' ■ * 

I. The primary objective of this study was to provide a means whereby a^yFT cahdidatc^s ability to 
'Icam to perform pBoting tasks couljdibc.quantified with a high degree of valiidlty . 

.2. Tlic , secondary objective was to provide tKc participa^^^^ 
sklis^.techniques, and Henietits-qf lnforimtion .which woiil^^ beneficial during . the tr3.7 phase ,6f 
{iRkructioh. . ' . ' 

As a:re^it ofJncrcasing pflot trainingcosts and reduced military budgeUythetUnited Force 
(the laingest .source of jet .pflots in existetjcc) is yitally interested in pursuing al! aychucsTor ic^ 
losses without reducing the quality of butput.:Of particular concern, is the continuing average of some 2S 
percent of all UPT entrants who pass all cxisting.prc-pijpt tfai 
elimiiMtedVrfo^^^^ reason or another after^beginning flight- tirain^ 

techniques will eyer.be deposed which wilKp^miit reducingithis.percenbg^ tb zero, ^there is some evidence 
available that, indi could bejcdiiced significantly. In; fact, in a recent study of UPT for thc^ 

l97S.to 1990 time frame, it was indicated that an attrition rate.qf iO.perceht.wouldLbe a realistic goal. 

To address the selection problem, it is necessary .to. rememW that the existing is 
composed of a multiple step selection process. First, the requirement for rnost pjlpi trainees to obtain a 
coOege degree insures a high level of mental:ability. Second, the use of the. Air Forbe (rffic^^^^^ 
Test (AFOQT) is designed to provide addition^ assurance that trainees haye definite aptitudes forjearning 
to pilot an airplane. Finally; the existing physical examination helps to insure that UPT candidates are 
physically fit for flight. The use of li^t aircraft in the pflot indoctrination program/flight, Instruction 
program (PIP/FIP) and T41 program furnishes primary instruction \^ich may reduce the odds: of- ah 
entrant -being lost from later program pha^ses. However, despite all these existing selection and saeening 
procedures, student attrition remains a problem. * 

The final component of the UPT candidate screening program is a;Course of itistructioh in the T41 
aircraft consisting of approximately, 16 hours of flight. In conjunction with this program ^.research is 
presently being conducted to determine the predictive value of psychomotor asMssment of UPT candidates. 
This research is based on a learning approach and consists of two coordination tests. One is.a gross measure 
of cycrhand coordination and the other a more coihplcx cye-hand-foot coordination measurement. Both 
tests incorporate p§ychomotor skills simflar to those, necessary to flying.'Positive results from this research 
hiay result in expanding the current UPT selection battery to iriclude this assessrnent. 

While the generally accepted role of ground-based flight simulators has been to enhance training or 
reduce required aircraft hoursjn pilot training, research evidence indicates that such equipment xould 
used fb effectively screen out those candidates who have minimum aptitude iii ihc areas of 
perceptual-motor skills. During World War II such devices were used to predict succcssful completidn of 
UPT, Two of the nwre successful were the SAM two-Hand Coordination Test and the Mashburn Two-Hand 
Complex Coordinator device. These devices were demonstrated to correlate reasonably well; with training 
performance; however, they were difficult to maintain and were eventually dropped from the UPT selection 
pfograrii. 



• Tlic^u»'.or grd simulators Jn a.screcnmg .role Has bcen-.receritly implemented. The 

..Dutch. Jhlnin selects and trains pUots forlorn airlines in the Netherlands, has 

. ;cyblyed aii ext>erndy;eff^^ scj^tfon program for pflot traineesXJ^. Smith, persond comniuhication,,.18 
^Juli^;i?7p^^ pn measurihg^ 

,candi(6tcs' -lcar^^^ on a scries of prope^^ .complex basic insimm^^ the 

JUnk: !^^^^^ stu^dics .have ^owni student performance ^ in subsequent^ fligia 

:t»iiuhg, phases t6;rcinain d^^^^^ in (Mscntially;,ihe same order^s that ^rccorde^ screening 

''JprO^lTfc^ ' ; \, \/ ' ■ \ ' 

* \* iRcscaixih uang ^ trainer ((StxTbel, Baum AHagin, 1971) established positive 

corrclatiqhs^^bctweeh, *ji(S instructor's evaluations of^^ as measured in these trainers and 

0\ ' . studcifit perfb the f-37 aircraft. theiStudy used a job sampling approach that simulated T41 

' ^J\npther;study;(H sampling approach to screening was an 

4 , accurate preilictoi: of perfprimnce on;tasi« re^^^ psychomptpr skills. Prediction accuracy increased in 

C , : • proportion to the e / ' / 

^ , Psy^giogicd Factoh Con^ 

r> " There have bceii numerous efforts.to identify; the psych61bgic;Ed fe the acquisition^ 

V ^/ flyi^^g ability. Althou^ such investigationshave typically produced taxbnomiesi Ihe.ability 
Jalcam;flying skills is.generaDy beliewd"t6;be pnrm composed (as are nearly all skijled peiformance^^ 

^ of. cognitive;. pe^^^ arid motivation^ elements. Accordin^y, m this study, the tasks<on which 

' V student perfpXmance. was mwsured were /designed to incorporate cognitive and jjerceptusd-rhotor 

*V . , components to ^the greatest extent ;pqssible. t4o, attem^ was made to test for motiyaUon bec^^ 
/ ; V Mtisfacbry objective nSeasures of this fa^^ the UPT program. 

'Z ^The co^itive portiori'Of the j^^^^ tasks.cohsisted of three types of activities: ^(1) short -term 

, mcniory, (2) verbal information processing in noise, and (3) rote^ learning of procedures and npmenclature. 

The student's response to verbal directions^ and'^ a light box operati6n are examples qt a test of 
shortrterm-ihemory. The communications and <;direc(ions ;to. the student required the ability to process 
verbal information over ah inserted radio chatter background. Rote learning ability was tested by requiring 
tasks to be perfomed in certain sequences and by using appropriate nomenclature. 

The , perceptual-motor aspects of the behavior tested were tracking, manual dexterity, visual 
perception^ and reaction time. For mstance: the maintenance of heading exemplified, par excellence, -a 
tracking task, manual dexterity was tested by the many rnaneuvers requiring stick control; the very nature 
. of instrument flight tasked the student's abUity to interpret what he saw displayed before him and finally, 

/} . the operation of the light box was specifically designed to assess the student's reaction time under. 

; ' . tadc-loadiiig conditions. 

; - Approach' 

-5 , The approach selected for, this study was cpmposed of three major elements: job sample testing; 

\ trainingprograni adaptability; and, objective performance4neasure,s 

Joti^ Sample Testing. Selection of the material presented to the subjects of (his study required a survey 

V of the UIT flying syU tasks 'to determine tfiosis compatible with t40 capabilities. It was (determined 
that *all Insj^ru and navigation , procedures prescribed in ATC SyJlabus P4A-A could be 

; j 1 demohstraWd, pr^ and ^tested in the trainer. Although tinie constraints on student avaaability 

"7 ' ncccKitated the eliniin^^^^^^ of tVaining in instrunieiit penetrations, approaches, and some voice procedures, 

? ^he maneuver, u^^ in ihk study- constituted an extensive job iample.of the instmment training portion of 

the WT* progra In addition, the light boX;tasks provided an assessment pf the ability of each student to 
* perform, prpbler^^^ tasks. under the stress situations typical of those encountered duringJnstrument 

'flight. > - ' ^ , ' : . ' , 

' Tmmihg/!%gram Adaptability. This study was designed to be cphducted within ihe time span 
I ..'^ devoted to t-41 screening for previous classes. This was done to reduce Interference with the participating 
$7 ; ' 'stutlents' ongoing tifal^^ For the classes involved, T-40 training was in lieu of T4I training. The ptogram 
developed wa^ sufficiently flexible to accommodate delays due to trainer maintenance, instructor 
^ avaOability, or other unforeseen problems. \ ' ' 

o ' ' •' ■ " 6 ■ . • ■ ' , 



Student Performance Measures. In order to accomplish the purposes of \he study, it was necessary 
that the measures of student performance obtained from the T40 trainer be representative of the 
behavioral domain of UPT flying skills. In addition, it was desired that these measures be free from observer , 
bias or inexperience, and be highly practical to collect. These criteria were met by carefully objectifying 
each performance measure. 

Each student's "flying" abflity was measured, using performance indices that could be^observed in an 
objective fashion, simply recorded, and scored vwth little or no. interpretation. Three types of measures 
were used: • • • • 

1 . Aircraft Control Measure's, The degree of student control^ over the aircraft was determined by how 
closely airspeed, altitude, heading, power setting, etc., matched the flight parameters specified for a given 

' maneuver. 

2. Systems Management Measures. The tasks required of an Air Force, pilot extend beyond merely 
flying an aircraft. For example, navigation and weapons systerns must b(?:managed efficiently. System 
management tasks were simulated by using the light box to present analogqus problems, and the.student's 
response time and errors were observed. . . 

3. Flying Procedures Measures. Following procedures constitutes an important, part of the pilot's 
job. In the T40 study, execution of tasks of this nature was represented by communications, VOR 
procedures, etc, and scored as either correct or incorrect. . ' ' 

AFOQT Scores. The AFOQT was included in this study because its use entailed practically no 
additional effort and seemed to complete the set of predictor variables. The five sub-test's of this battery 
that were used consisted of: AFOQT I - pilot percentile; AFOQT 2 - navigator.percentile; AFOQT 3 - 
quantitative percentile; AFOQT 4 - quaTitative percentile; AFOQT 5 - officer quality percentile. No 
further description of this instrument is contained in this report since it has been completely described in 
many other sources. 

. II. METHODS AND PROCEDURES 

Subjects 

Undergraduate pilot training clai^ses 74-05, 74-06 and 74 07, assigned to Williams AFB, were screened 
for eligible subjects. The planned restriction to use subjects completely naive to flying proved impractical 
because of the incidence of flight experience among the class members. However, Air Force Academy 
graduates and students who had completed the ROTC Flight Indoctrination Program were not considered 
eligible. Additional restrictions to eligibility were:* 

1. Civilian flying experience not to exceed 1 50 hours. . ' 

2. USAF navigator experience restricted to non-fighter type aircraft (e.g., B-52 Navigator). 

• 3. Other military flying not accomplished during past three years (e.g.. Army helicopter pilot). 

The number of students completing the study program was: class 7405, 54; class 74-06, 38; and class 
74-07, 36, for a total of 128. 

Description of Apparatus 

The A/F37A-T40 Instrument Trainer contains side-by-side pilot's and copilot's stations 
closely resembling a T-39 cockpit. At the aft end of the cockpit section is an entrance stairway and 
platform. The motion system hydraulic power supply is located under the platform. The computer modules 
and electrical power equipment are located in the nose of the cockpit'section. 

The motion system has two degrees of freedom (pitch and roll) mth a cue •'wash-out" system. The 
operator console duplicates most of the cockpit instrumentation, and contains "problem freeze," "altitude 
freeze," and ''position freeze" features. Instrumentation on the pilot's panel is somewhat similar to a T.38; 
the copflot's panel closely resembles the T-37 panel. 

Modifications. For the purposes of the study, certain modifications to the basic T40 Trainer were 
required. 



Audio Communications. Electrical wiring was modified to permit a cassette tape to be played 
^muitaneously into all three trainers through the UHF radios, to the three operator consoles, and to an 
adjustable volume speaker in the console awa-Cockpit /console wiring was modified to permit the console 
operator to inonitor and interrupt *'hot-mike*' signals from both cockpit stations. In addition, , to make the 
T40 microphone, system compatible with Helnoet Gu22P/Mask BU5P worn by the subjects, an 
Jmpedence^tcHing {>ower supply-amplifier was added to each trainer. 

pperator. Station. Features:pf the T-4b instrument console used in this experiment were displays of 
altitude; airspeed, heading, rate-of-climb, and UHF frequency. These features, of course, are standard, but 
mounted o' each console table was a light control box. Each control box contained three sets of toggle 
switches; on^ set uf nine and two sets of three switches. On the face of the box were also mounted START, 
ERROR, COMPLETE, and POWER ON lights, START and STOP buttons, and a POWER ON/OFF switch. 
Each control box contained its own event timer. This timer was started by the operator the same instant 
light problems were presented. The tinier was , stopped, either by problem solution in the. cockpit or 
manually.by the operator when the allotted time had expired; 

r/m/nf. Console operators used an elapsed-time clock located above Console #1 and clearly visible to 
the other operators. This timer was Used to allow operators and instructors to keep track of the timed 
instruction blocks and to prepare for data recording during test periods. 

Instructor and Operator Personnel 

The instructor and operator p^jrsonnel used in the study played a highly important role. The 
following sections describe their selection, training, and duties. 

^1 • * » 

Instructor Pilots (IPs). Six groups of 12 IPs were utilized in presenting the T40 course of instruction 
to the three participating UPT classes. These IPs were selected from the 96th FTS (T-37) and the 97th FTS 
(T-38)at Williams AFB. 

Instructor pilot experience ranged from recent UPT graduates awaiting assignment to the Pilot 
Instructor Training Course to IP^ with several years' experience. IPs assigned to Air Force Human Resources. 
Laboratory, Rying Training Division (AFHRL/FT) served occasionally on a fill-in basis. The aVercge IP 
used in the study had approximately five and one-quarter months' instructing experience and 600 hours 
total flying time. These instructor pUots averaged 190 hours experience in active fli^t instruction time. 

Each group of IPS presented eight lessons coipprising one half of the course since flight line 
operational requirements would not permit the retention of a single group of 1ft long enough to present the 
entire program to a class. 

IP training was divided into group briefings and individual training sessions. AFHRL/FT pilots 
conducted the IP training. An outline of the group training session subject matter follows: 

I. An introduction including program objectives, related screening programs and research, general 
methodology, and student/instructor scheduling. 

^ 2. T-40 simulator orientation including cockpit layout, control response, and freeze and reset 
features. 

3. Study of the program guide including format and task descriptions, methods for student "hands 
on" instruction, and reeinphasis on standardization. 

4. Demonstration of the command tape. . « 

5. Demonstration of test data recording. 

6. Demonstration of light box tasks (for second IP group in each class). 

After the group oriefing, each IP was given a thorough, checkout in the T-40 trainer by an AFHRL/FT 
instructor. The IP practiced flying each maneuver to be presented, resetting the trainer to parameters 
specified in the program guide, instructing from the guide in coordination with taped time signals, and 
recording test data vAAt the HRL instructor flew a typical test. 

Included in each student training period was a thirty-minute briefing, a forty-five minute trainer 
flight, and a fifteen-minute debriefing. During the briefing, the IP reviewed and discussed the student's 
study assignment, used the program guide and an instrument pane! training aid in explaining the maneuvers 
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to be covered, and answered questions from the student. Tlie program guide and taped time and test signals 
controlled the instructor's presentation during the trainer fliglit. 'The IP was also required to reset tlie* 
trainer to specified parameters, repeat taped test commands for the student, and record data during tesi 
periods. After the trainer flight, the IP gave the student a critique on his performance in the trainer and 
answered student questions on the material covered. The st'ulent's study assignment for the folUvving' 
lesson was given at this time* 

Console Operators. Operators were temporary civil service employees with clerical experience who 
were hired specifically for this study. 

Operators were tramed to read and interpret the aircraft instrument displays on the T-40 console, 
record leadings on specified instruments, reset the trainer position and operate the light control box. The 
chief console operators were further trained to operate the cassette tape player and tl\e master timer. 

The primary duty of each console operator was data recording during the traimng sorties. The course 
outline and data recording forms kept the operator informed as to the specified data recording 
requirements. Time signals indicating the instant the required readings were to be taken were received over 
the operator*s headphones from the tape player. Hie taped commands to the student enabled the operator 
to keep track of test progress. At the end of each period, the chief operator restarted the tape and 
synchronized the master timer with the new tape. 

Durfr.g :hc portion of the program devoted to VOR training, the operators were required to 
reposition ^he trainer to predetermined locations on command from the instructor. 

The final four training periods were continuous testing sessions and require'! the operators to initiate 
a new problem on the light control box t forty-five second intervals, record reaction times, errors, and 
instrument readings. 

When not Oi'cupied at the console, operators collected and scored the test fomis containing the data 
collected by both operators and instructors. 

Syllabus Devdopment 

The syllabus of instmction (Appendix A) for this stud> was designed to use the job sample approach 
for screening candidates for UPT* Also, the nature of the study required that identical quar titles of training 
be administered each student in order that the testing provide q valid indication of each student *s ability to 
attain those skills being taught. The predictive criteria were determined to be the candidate*s ability to 
assimilate, retain « and utilize information presented in a Hying training situation. Since the devices :^Vai!abIe 
for conducting this study were T-40 instrument trainers, the UPT syllabus -was examined to determine 
which of the UPT tasks could be effectively trained in the T-40. 

T-40 Capabilities, All instrument Hying tasks included in the T-37 phase instrument check were flown 
by current T-37 instructor pUots in the T-40 trainer. The only maneuver tlie trainer was incapable of 
performing properiy was the aileron roll (a confidence maneuver) due to the absence of response to 
backstick pressure when bank exceeded 90 degrees. 

Syllabus Design^ The syllabus was constmcted to accommodate a student with no flight experience 
and no knowledge of aircraft instruments. A bullding-block approach was used, starting with straight and 
level instrument fliglit and increasing task complexity in logical steps. The scope of the training program 
was limited by the length of time the students were available. Each student was instructed in basic 
instrument maneuvers, progressed to steep turns, confidence maneuvers, and unusual attitudes and 
concluded with practicing VOR instrument navigation skills which included course interception and holding 
patterns. 

Academics, Academic instruction during the screening phase of UPT has not, in the past, contained 
any instrument flight lectures. This training normally is first encountered during the T-37 phase. Rather 
than move a block of instrument flight lectures into the screening pliase, then repeat the lectures during the 
T-37 phase, an alternative was exercised. The T07 academic section of the 82d Student Squadron prep-jred 
a special T-40 Instrument Procedures work book (Appendix B). The contents of the work book were 
limited to instrument tasks and procedures covered in the T40 study. These work books were issued to 
each student for independent study. Students received additional daily reading assignments in AFM 51-37, 
Instrument Flying, and ATC Manual 514, Primary Flying, Jet. Access to these manuals was strictly 
controlled tc provide equal study time to each student. 



, ^ T^wti Table I g: 
fiistintroduced. » 



gives ;thc list pfjhc-training tasks.sclcctcd and the softie number in whicli the task was 
Table him Tnmg J 



SoVtit No. 



1 

2 
3 



6 
7 

8and8A 



10 
II 

12-16 



;TaiJt 



T?46jraiher Familiarization 

Straight and Level ^ ^ ^ 

Attitude Climbs and-Descents 

Constant Airspeed Climbs and Descents , ^ 

Level Off ^ . : ♦ 

Change dPAirspeed^ - ' ' 
Normal Turns (30'' Bank) 
' NdrmahTurns to Headings 

Change of Airspeed in a Turn 
Climbiiig and D^ending turns 
St eep Turns (eo"* Bank) 

Rate Climbs and Descents 

Simultaneous Changes of Headings Airspeed 
and Altitude 
Vertical "S" - Delta^ 

Unusual Attitudes 
Wingover 

Instrument Takeoff 
Tech Order Climb 
VOR Honing 

RMI and CDI Intercepts 
VOR Holding 

Standard Instrument Departure 

Composed of a series of light box stress 
tasks superimposed on the performance of 
the simpler basic instrument flight 

' maneuvers introduced in the first six 
'sorties. 



Instructional Techniques. In order to present a highfy standardized course of instruction with 
maximum "hands on'' student training, the number of situations requiring individual instructor technique 
or a judgment by the student were minimized. Actions required to perform a task were proccduralized to 
the maximum extent possible. For example:. 

Turns fo headings ~ the recommended rollout lead point of one third the angle of bank was 
changed to procedural lead'points of 10** for a 30° bank and 20** for a 60** bank. . • 

2'. Level off - the recommended lead point of approximately 10 percent of the vertical velocity was 
made a firm procedural lead point. 
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Standardization A nuijor problem in prcsciUing higlily slaiulardi/ccl training ro cacli sludcnl was to 
ovciconw variations in instructor quJIity . IP experience ranged Iroin zero instructor time to over lour years. 
To iniiiiriii/.c tliis eflcct, a detailed course outline was prepared wiucli covered point4^y-poiut, tlie items to 
be discussed in eaclunussion briefing, traiuer fliglu, and debriefing. All instructors were directed toadliere 
strictly to the course outline and to refrain from using individual teclmiques in presenting tlie training. 

TIic -taped Ji.me signals, received over tlie instructor's Iieadpliones, legulated tlic lengtli of training 
tinie to be devoted to each task. 

All instruction in the trainer was presented verbally. No IP deuTonstrations were utilized Witli the 
exception of the unusual attitude setup, the student had the Vainer controls througliout the progrini. 

Study Design 

The study design was modeled along tlie classical predictive paradigm conimon in applied 
psychological research. Of necessity, such an approacli.is longitudinal and uses actual job performance as 
criteria. Based as it is upon empirically cstablislied validity, tlie model is robust. Results obtained from tin's 
approach are truly representative of the predictive power of ihe test instrument since the study conditions 
actually, duplicate the selection situation. Tlic test instrument, of course, was a job saitiple and this added 
relevanceito the study because the more closely the selection instrument reproduces the beha^pral tasks of 
the.actual job, the greater the content validity of thesclection procedure. Tlie job sample test was directly 
related to the activity to be predicted, gave the UPT candidate a taste of piloting, and was minimally (if at 
all) culturally biased. Individual differences in abfliiy wre manifested in differential perfonnance on , 
simulated pSoting tasks. 

Controls. One of the major difficulties in an approach of this type is maintaining control over the 
experimental environment. In the present study three dimensions of control were used. First, students in 
each of the three classes were randomly assigned to one of two sections (A or B). During the course of 
training the period of instruction was counterbalanced between ajn or p.m for two sections. Second, a 
tightly controfled plan was developed to alleviate potential instructor/trainer/period of instruction 
interactions. Through careful scheduling, it was possible to insure-that each student had approximately the 
same number of training flights in each of the three trainers, at different periods of the day, and with the 
same number of different instructor pilots. As a result, IP-student interaction effects were minimized, 
trainer device idiosyncrasies were iicgated, and consequences of circadian functions within students were 
greatly reduced. Third, by making the training period 3 minaturc replica of the flying task, events were 
highly structured. The student's sequence of activities always followed a rigid pattern: sortie preparation 
(45 minutes of individual study on printed materials germane to the sortie); pre-sortie briefing (30 minutes 
in which this mateYial and the sortie were reviewed by the student with his IP); training period (45 minutes 
of T-40 instrument training), and sortie debriefing (15 minutes of performance critique by the IP fcr the 
student). 

Testing Procedures, Tlie test of the student's performance adhered to a completely structured 
protocol. Each test occurred at a predetermined time during the 45 minute period. In all, 25 tests were 
administered to each student. The first test occupied 10 continuous minutes in the second training period; 
the 20 subsequent tests were contained in two five-minute intervals occurring during each of the next 10 
training periods, in the latter case, each five-minute test was separated by appioximately 20 minutes of 
training. In the remaining four periods (i.e., tliose incorporating light box problems during the performance 
of flying tasks), response time/accuracy measures and instrument flying task proficiency measures were 
observed continuously throughout the training period. 

Testing instructions were relayed to IPs and operators via headphones. These instructions dictated the 
initial setup conditions of the simulator (e.g., altitude 16M, heading 360; airspeed 250 kts, etc.), and the 
particular test to be given. A one-minute preparatory interval followed in which the simulator was set up; 
the IPs and operators prepared to collect data; and, the student was alerted that a test would occur. 

At the beginning of a^ test, a taped signal (i.e., beep) was given to IPs and operators. The IP then told 
the student what maneuversto nerform. As the student attempted this task, '*beeps^* were sounded at 
lO-second intervals over the headphones of the IPs and operators. Cued by these stimuli, IPs and operators 
recorded designated instrument readings from their panels. This process continued until the test was 
completed. 
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s<, \. V^Pf!!!^^^'y^^^ ^ ^P^^^ ?5 feeintrpductidh threexlasses of objective measures of piloting 

peifo^ and flying prCHWdures -r \ww developed in order to 

h /; „ kudint^ By i^ng tiler jo^ sample a(>prc^ tested student , behaviors: w^^ 

\ . ^refet^ specified task performance 'Hius all recorded obsemtions of the student's 

. ^ pcrfonnai^ scored upon ab«>lute.kahda^ as defliied by Uic iriaiicuvcr JescTipU irtiUFT. 

Np:ju<^^nm^ to the quidity. of the perfonnj^ only, the student's measured deviations from 

••#?Wimedcn^^ - 

t/'- Tlie ^idepe&dent >varnbk$^ to the threcj classes of objective; measures; of pfloting 

- perfoimanj^lwCT^^ ^ . • ... \ / 

^ U; Mema^ pf tm [wameten (the of aircraft .control). Variables used were; 

' airspeed (ih^^I^ ^litudi (in fcet),rfi5ading: (m degrees), pitch (in barwidlhs or (fences), bank On 

,de^ees), pitch/^ cdprdinatioii (di^Iayed PP^M?" on the artificwd h^ 

^ : (in fMt per nQiuite), and — incdrret^t rale u^d). tlie foUqv^ing exaniple is.glyen 

to darify the u« b^^ 250 faidts li^U stude^^ 

256, 251, 2«1 250, and. 252, this 
perfpnmnccwer^^ * ^ 

V ^2. Mmuris of 'sys^^ box, problcmsiof various degrees of 

conq)lexity were presented to ^ 

student reqidred to solve these.prpblems and the. accuracy (ile., correct or incorrect) df his solution were 
recorded, ^. ^ . ^ ^ 

3,.^Measures of flying procedures compliance. This set of variables consisted of power setting, VOR 
,coursc;mterccpt, VOR-holding, take-off procedures, turns to asdgned headings, recovery ffrom unusual 
attitudes, and dmple radio communications. The student's performance ws recorded as either correct or 
/ incbnect. 

, ' . llic result of this effort was to produce 25 tests 5n which the total number of items was 342. Sncc 

th^ testing tirhe was fixed, the actual number of items in each test varied, but the total.was approximately 
the same for all tests. Of the 342 iteihs, 208 were composed of "continuoiw** dependent va^ 
obsemtions (e.g., airq^ee^ and .134 were composed of "discrete" dependent variable observations (e-g., 
power setting as correct or incorrect). Examples of the specW test forms prepared to record these data are 
presented in Appendix C. Acting on;the taped cues, data. recording was accomplished by, the instructor 
pOots arid Uie console operators usm^ ^ 

' fMimiiiafy So^ 

Before the data could be scored, it was necessary to t:orrect certain data points to account for 
transitions during a maneuver, instructor errors, or minor trainer malfunctions. Specific examples of these 
situations are: 

1. Transitions. During airspeed or altitude changes, a short time interval was allowed for the IP to 
repeat the;command and the maneuver transition to be completed. Only data points occurring after a 
transition was complete were scored. As an extreme case, six data points were recorded for a transition 
from 250 KIAS to 230 KIAS. It takes 30 seconds for an IP to repeat the command and.for a properly 
executed airspeed decrease to occur. To allow for this 30 second interval, the first four airspeed data points 
were deleted and only the last two were scored. 

Bank data were scored during the lime the aircraft should have been established in a turn. Data points 
at which the aircraft should have been rolling in or rolling out were not scored. 

^ During the Vertical S maneuvers, only data points at which the aircraft should have been in a steady 

dimb or descent were scored. These points occurred at :20, :30, :50, 1 :20, 1:30, 1:^0, and 1 :5b minutes 
after the original xonunand. All other points were omitted from the analyses because they occurred during 
transitions. 

The iiistrument take off could not be scored based solely upon the time elapsed from the.original 
; ^ command. Ift did not always get the trainer set up. in time for the student to begin the task on command, 

. Therefore, the task was not considered started until brake release, at which point airspeed showed an 

increase. The maneuver *iTO to 5,000 ft" is a task that aiustratcs this point (Test 9-1 , 10-1). Tabic 2, 
which is a partial copy of a test form, is given below to fllustrate the discussion of these points. 
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Table 2. Test Form niiisbatioii. 





Airspttd 






ntch 




^^^^ /\ 


y 


y 


y 


Release 










(first 


X 


360 


X 


X 


airspeed 










increase) 


X 


360- 


X 


X 




X 


360 


X 


ID 




X 


360 


X 


• 10 




X 


360 


X 


10 








A • 






220 


360- 


X 


X 




220 


360 


X 


X 




220 


360 


X 


X. 




X 


360 


X 


X 




X 


. 360 


X 


X 




250 


■ 360 


5000 


X 




250 


,360 


5000 


X 



X = Non-rclcvant DaU: Transitiona! State* etc. 
AU rcadu^ taken at lO.sccond mt^rrvals. 



The test form example in Table 2 indicates edited data with an X in the appropriate dsta space. The 
desired viue for each data point was placed in all other data ^accs. Tests were scored by computing the 
absolute dcmtions from the desired value.; Niunbcrs in the data space on the discrete items, such as 
communications, indicated the value assi^ed to that particular response. The examples of test fonrn 
prescntedih Appendix Cindudc this informatioh. « ^ . ^ 

2. instructorfTmincr Malfiinctiom: In a very few instances, the instructor pilot recorded the wrong 
data on the test dieet,Tailed to record the data, did not set up the trainer in the proper configuration, or 
gave erroneous instructions to the student. Also, trainer malfuncUons occasionally in^idated some data. 
Such aiuatiohs were rare and accounted for 'less than 25 percent of the total amount of information 
collected in the study. To fill in the missing data ceUs,,a simpjificd version of the estimation method 
described by Bennett and Franklin was used (Wner, 1971 , pp. 487490). 

' t 

Rnd Scoring Procedures. When the data matrices were complete, the final scoring steps were 
performed. Since three dasscs of objective measures of piloting performance were used as dependent 
variables, a procedure was required for scoring each type of measure: 

I; Measures of Aircraft Flight Parameters. For these measures, the absolute deviations from zero 
(i.e., perfection) for each separate parameter for each maneuver item were converted lo Z scores. Large 
deviations, therefore, were represented by large, positive Z scores. Small deviations (or zero deviations in 
the case of outstanding performance) became large, negative. Z scores. This procedure should be 
remembered in subsequent discussions of the stucfy results because it explains why negative correlations 
exist between the predictor and criterion variables for this class of measures. 

2. Measures of Systems Management AbUity. These measures consisted of response time and 
accuracy. The procedures for scoring response times were identical with those described above and similar 
results were obtained. Inspection of the data revealed that there was too little variation in accuracy scores 
for these measures to be useful predictors so they were exduded from further processing and analysis. 

3. Measures of Flying Procedures Compliance! These discrete measures were scored by simply 
calculatmg the percent of correct responses out of the total opportunities" presented. These percentages 
were then Z scored. ^ * 
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Aulbmatic Dila Piroceasing, 

The data entered on the test forms was scored and then keypunched on IBM cards. After yeriflcation. 
these caTdsf were read onto magnetic tape and all further data processing and statistical analyses were 
performed on AFHRL/FTs SEL 86 computer. 

Oiteria 

The selection of criteria measures for quantifying achievement in UPT is not a simple, straightforward 
process. As with most human undertakings, **success" is a relative matter, and may be viewed from either 
an individual or institutional standpoint. There is also a temporal aspect to this problem and the 
determination of when criteria have ripened sufficiently is a subjective Judgment. But there do exist 
practical considerations in UPT which, to some extent, force an operational definition of **success.'' At the 
most primitive measurement level passing or failing students may be identified; this.crude dichotomy can be 
refined by using the grades assiped to students based on the performance they exhibit during training. An 
additional consideration is that the vast bulk of student attrition occurs early (i.e., first eight weeks) in the 
T-37 phase of UPT. 

Concludbns that may be drawn from the preceding paragraph are: 

1. The T-37 phase ofUPT is an appropriate time to develop criteria: 

2. A choice must be made to use pass-fail and/or performa[nce grades as criteria. Consequently, this 
point wQl be discussed in some detail. 

Pass-fail is an uncomplicated criterion measure, but it may, in some cases, be inappropriate. There are 
six Air Force categories for attrition, or failure, in UPT: flying deficiency, self-initiated elimination, 
manifestation of anxiety, academic, medical, and administrative. Although it has been argued that the first 
four categories reflect a lack of flying ability, experienced investigators know this is often not the case. 
Student motivation, managerial attitudes, administrative convenience, and a plethora of less easily labeled 
circumstances invalidate such an assumption. However, the pass-fail criterion is extremely easy to use and, 
since it did not complicate the analysis, it was included. 

Performance Grades • 

T-37 phase performance grades offer criteria that more closely sample the domain of flying ability. 
These grades are generated under nearly equivalent test conditions, assigned by highly experienced check 
pilots and trained IPs, and can be combined to produce a more accurate (and probably stable) picture of 
the student's capability. Admittedly,^most of these grades are based on rating3,.but these ratings are 
judfciously allocated. In fact, these grades represent the best measures of flying ability available in the T-37 
phase of UPT. 

Four T'37 phase performance grades were obtained for each non-attriting student. These grades and 
their composition were as follows: * . 

1. T'S7 instrument chechride grade. Composed of the summed ratings on maneuvers given on the 
T-37 instrument flight check. 

2. Combined T-S7 check-ride grades. The arithmetic mean of the rating scores obtained on the two 
T-37 phase contact check rides and the T-37 instrument check. 

3. T'37 flying score. A composite of (I) and (2), above, combined with ratings on maneuvers which 
were assigned daily by the student's IP. 

'cr.^^^'.^P^^^^" 7'-J7p/ia5e^W(/e. The final grade assigned at the completion of the T-37 phase; com posed 
of ( 1 ), (2) and (3), above, and the st udent's academic grade . 

After careful consideration, the T-37 instrument check, the T-37 check rides, and the overall T.37 
phase grade were selected as criteria to be used in this study. 
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Data Analysis 



Tiic data analysis was based on three sequential steps: combining individual test items into larger 
units of analysis; determining the rcHability of these units: and, developing the equation to express the 
relationship between predictor variables and criteria. 

Item Combination. The 25 tests were composed of 342 items of which 208 were defined as 
continuous measurements and 134 were defined as discrete measurements. Since the total number of UPT 
students participating in the study was only 128, it was necessary to combine these items in a logical 
manner to avoid . over-determination of prediction* This problem had been foreseen at the outset of the 
study and its solution was easily obtained^ The test iteins were merely the observed parameters of certain 
selected piloting and psychomotor tasks; e.g., straiglu and level insirument flight and response time,Nyhich 
had been converted into Z scores. Thus, the various items could be readily combined into perfectly 
homogeneous groups of tasks. The proper nomenclature for these item groupings is a maneuver, an 
activity, or a procedure, depending upon the nature of the task involved. Tables 3, 4^ and 5 identify these 
task groupings and list the number of items so combined. 



Tabic i. Maneuvers 



Number 

Name of Items 



Straight and Ixvel Fliglit ' 26_ 

Pitch Control Maneuvers 4 

Change Airspeed 1 2 

Climbs and Descents 1 8 

Turns 22 

Rate Climb or Descent 6 

Complex Turn 22 

ITO 12 

Vertical "S" Alpha 8 

Vertical "S" Delta ^ 4 

Steep Turns * 19 

Stressed - Straight and Level Flight 6 

Stressed -Altitude and/or Airspeed Change 5 

Stressed - Complex Turn • 8 

Stressed - Rate Climb or Descent (VS-A; VS-D) 7 



Table 4. Aetivities 





• Number 


Name 


of Stems 


Frequency Response Time - Practice 


2 


Single Light Position Response Time - Practice 


2 


Double Light Position Response Time - Practice 


1 


Frequency Response Time 


11 


Single Light Position Response Time 


II 


Double Light Position Response Time 


2 



Table Xffocednv^ ^ 



\ ^ Numbtr; 



CoinnWnica^ .... / . ^ 

: Power SdUing^^ ^ r . : . , r , ' 12 

Turn Dircctib^^^^ ^ ,v:;' \ * : - - 1^ ? 

/ WjngoVcr^^^^ ; ^ 

Wingoycr : }--^ / 18 "r 



Reimbility, the reliability, of each: honiogenqds^ Jroup. of tasks estiinalcd using the 
JKuder-IUcli^rdion fbrmula 20 to dcicfminc its internal jcon^^^ pp. 158-161). 

'Prcdkik>n^^ Jwo^ cqhtradicitojfy princiiJtt arf involved in^^ 

•rej^esslon.ejqu^^^^^^ predkt^ principle attempt s-to^^ as many 

predictor km (in order to obtain: thc.,b^ while- thc^ ^cohd principle seefcs 

pardimny^^^^ collection ai^ interpretatiqh.jfte 

principl^: B a. matter of 'experimenter.Ju as; to what method will; producc;thc **best'*^ regression 

;<K)uaUpn.i|1ie^m iri the study^^^^^ 

Sniith (1966, pp. 163-171)- the rcsuiting^prc^^ equation ra:onci!cd these opposing principles in an 
optmuin manner and was applied to the pass-fail criterion, the t-37 instrument check, the T-37jcheck 
rides, and the overall T-37.pi^ grade criteria. - ' 



^ . IIL RESULTS 

The study results, in general, are a satisfactory, conOrmation of the job sample approach for UPT 
.selection and screening. This is particularly true when the technique is comparisd with AFOQT paper and 
pencil testing afid used to predict t-37 phase flying performance scores. The succeeding paragraphs will 
rejK)rt the study results iif detafl, bc^nning with descriptive aspects of the data and concluding with the 
infereiKesthat may bed^^ , 

Ufa D«»riptioii a^ 

Inspection of the raw data revealed its characteristics and the analysis proceeded through certain 
"trial and error*' steps that were determined to be unfruitful and were discontinued. 

Data Description, The absolute sc6re$:for^the continuous dependent variables pbserved. in the study 
h|d an excellent range^ the minimum v^ a factor of two for r^ponse 

time Kores^^ yaru^ity/^o^ ws approximately three orders of magnitude for maintenance 

of ^titudc durinis ceiftatii irancuycrs; The range of scores observed for the discrete dcfpendent variables Was 
not is grwt^ also, good variability was present. For these riieasures the range of scores ran from 

n«|riy a factoro^^ • - ' ■ ^ ^ ^ ' 

An analysis pf the of the distribiitfon was performed ^6n the ^ raw scores, for one of the 
continuous d^^ yariaWes* h was foimd to be Gau^ian (in fact, a neariy "perfect** bell-shaped curve) 
and inspccjtion: variables Ap^ tficy exhibited the same clwradteristic. TT^ 

anumption of underlying^ distriWtk>h appinired jusiifled for this class of data, the distribution 

'.^f?— variables was dightly negat>cly ^skewed (as would be predicted) but this was to such 
a likiddt degree that a normalizing transformation was not deemed necessary! 



Abandoned Procedures. Two. procedures-used; in. the early stages of the analysis .were discontinued 
wheii they were* found/tq -be unnecessary and redundant. This activity is reported only as a guide for other 
jeaarchefs m.^he area aiKe.th prpcedures:have been frequency enripjoyed in the pasLFtfst, the use of 
root . mean square (RMS)'e^6r terms fo/ the continuous dependerit'variables contributed nothing: beyond 
the. use of ^niple absolute scores* This: is not ahcriticism of RMS measures ^ but udei^ automatic record ing 
and.trans^^ of data is ayanable, such a step n^y introduce additipnal arid unrequired effort ; Second, 

.cheating. tolerani^^^^ Z^uhits frqni the mean (50 and 68.4 percent of the distribution, 

respecUvely):and:^^^ excursions into:the^ bands^^id not make a sighincan^.impro^ 

:prediction . The lowest correlation observed betwecn counts of these, excursions and absolute scores was .88 
:wiUi:the mcdm^^^ 54: Ergo, this procedure was deemed superfluous and dropped 

from the aiudysis. * ' . ' * • , . 

Coht^uoiis Depejnikn^ ^ 

The job sample approach used in 't^^^ study enabled the test instrument to be designed as a power.test . 
Ato, since eac^ activities were composed of identical fask .eiements arid 

nic^Burcd by 'thcj it may;bf safely ass^ that the underlying test structure is 

iiWactor. Bas«d on these cqnsiderati reliabiii'ty,6rth« ohe-ifact6r,>p6weMes^.wasc<^^^ using 

rpuiinc statbtic^ methods. Table 6 presents^the relia^ to: twp decimal places) fo^:the 15 

TOneuycis.. , • ' ^ \ ^ - ^ 



fable 6.Mmi\vKti. 


Namt- 


Rciubiiity 


Straig}tt arid Level Flight 


.63 


Pitch Control Maneuvers 


j66 


Qiange Airspeed: 


.54 


Gimbs and Descents 


.70 


Turns 


.77 


Rate Climb or Descent 


.63 


Complex turn 


.69 


ITO 


.60 


Vertical "S" Alpha 


.64 


Vertical Delta 


.52 


Steep Turns 


.59 


Stressed - Straight and Level Flight 


.54 


Stressed - Altitude and/or Airspeed Change 


.50 


Stressed - Complex Turn 


.63 


Stressed - Rate Climb or Descent (VS-A; VS D) 


.67 



The reliabilities for the six activities (again rounded to two decimals) are given in Table 7.* 
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' Erequehcy^ Response time ~ Practice " .64 

; SingleiU^t l^dsitib^^ - Practice . .63 
/.{D<>ublc;i4ght P^sUioh Response Tiit]e - Practice . 

Oneltem-' \ * > Indeterminate 

Frequency itespo^ .88 

. Sin^e li^t Position Rc^^^ Time " .92 

Double* Light Position Re^qnse Time ,-77 



As inay be seen in Table,6,. the maneuver reliaSilities;iange from.iO to .77 with a median value of 
.63. Althougji: these, vM high> eh6ugh fpf ith^ ^ be used as established, psy^^^ 

instrument^, they are jtjuite.encoufaging and warrant further development of the job sample approach.. 

The response tinies (which were Jhe def^endent variables measured in the activity tasks) were found to 
be hi^ly . reliable after practice. The observed values. are in.excellent agreement with those feppfted in the 
literature; a n»st satisfying re^ 

Cbnrehtioiis with T*37 Phase Criteria 

Of the i2i8 students who completed the study program 71 completed tiie t-37 phase of instruction 
in UPTy Thus, the total degrees of freedom between the predictor variables and the criterion variables (i.e., 
T-37 instrument check, T-37 check rides; and, overall T-37 phase grade), was 69,.but since tabled 
sigjiificance level values exist for 70 degrees of freedom, the latter was used for convenience. Table I>-1 in 
Api^ndix P gives the means and standard deviations ifor all predictor and T*37;phase criteria variables used 
in the.study, and table P-2 giyw tHe complete correlation matrix. All correlations are Pearson Product 
Moment r's uncorrected for curtailmerif. 

Table 8 presents the correlations between the predictor variables and the T»37 phase criteria. As 
regards the IS maneuvers, 13 are significant at the .OS level and 11 at the .01 level when used to predict 
T*37 check ride performance. These IS maneuvers do not predict scores on the T*37 instrument check as 
wellj only liine are significant at the .OS level and 7 at the .01 level. Rrijdly, and best, these maneuvers do 
show substantial correlation with the overall T-37 phase grade: 14 out of IS are significant at the .01 level 
of confidence. Corresponding statistics for the 6 activity variables are: 3 and 1; 0; and, 4 and 2. The 9 
procedure variables were disappointing as predictors with their orderjn this respect being 3 and 2; 1 and 0; 
and.4and2. 



Table & Correlattom with T-37 Phase Criteria 









Crittribn Varlibit 








T-37 


T.37 


Ovtraii 


Prtdktor 


VariaMt 


Chick 


Instrumtnt 


T.37 


VariabK 


Namt 


Ridts 


Check 


Phai« Gradt 



Maneuver 



1 


Ml 








■ 2 


M2 


-.37** 


-.30** 


-.41*? 


3 


M3 


-.33** '• 


-.43**. 


-.43** 


4 


• M4 


-.44** 


-.34** 


-.52** 


5 


M5 


-.03 


-.02 . 


-.07 


. 6 ' * 


M6 


-.37** 


-.17 


-.47** 


7 


M7 


-.53** 


-.49** 


-.6i** 


8 


MB 


-.23* 


-.20 


-.34** 


9 


M9 


-.35** 


-.14 


-.46** 


10 


MIO 


-.27* 


-.20 


-.38*'* 


11 


Mil 


-.35** 


-.25*' 


-.43**' 


"12 


M12 


-.30** 


-.30** • 




13 


M13 


-.32** 


-.28* 


-.36** 


14 


M14 


-.21 


-.21 


-.35** 


15 


M15 


-.36** 


-.35** 


-.37** 


Activity 










1 


M16 


-.20 


-.17 . 


-.25» 


2 


M17 


-.28* 


-.11 


-..35** 


3 


MIS . 


-.11 


-.09 


-.13 


4 


M19 


-.17 


.00 


-.17 


5 


M20 


-.23* 


+.01 


-.25* 


■ 6 


M21 


-.34** 


-.12 


-.32** 


Procedure 










1 


M22 


+.17 


+.03 


+.24* 


2 


M23 


-.03 


+.01 


+.05 


3 


M24 


-.10 \ 


-.07 


-.01 


4 


M25 


+.34** 


+.25* 


+.41** 


5 


M26 


+.26* 


+.12 


+.29* 


6 


M27 


+.10 


+.13 


+.08 


7 


M28 


+.08 


+.16 


• T.06 


8 


M29 


+.30** 


+.19 


+.31** 


9 


M30 


+.09 


+.11 


+.19 



* Significant at .05 level of confidence. 
Significant at .01 level of confidence. 



Table 9 is abstracted from Table D-2 in Appendix D. It shows the correlations obtained between the 
AFOQT Battery and the T-37 criteria as well as the intercorrclations of the criteria. The findings of major 
interest revealed in Table 9 may be briefly summarized. There are no correlations significant at even the .05 
level between any of the AFOQT subtests and the T-37 phase criteria. In fact, the highest correlations 
observed account for only 2.25 percent of the variance and the "direction" of one-half of these is reversed 
(i.e., negative). As would be expected (considering their composition), T-37 phase criteria are strongly 
intercorrelatcd with in-common variances ranging from 50 to 80 percent. 
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Table 9. AFOQT and T-37 Phase Criteria Correlations 





AFOQT-1 


AFOQT-2 


AFOQT-3 


AFOQT.4 


AFOQT-5 


Ck Rides 


Instr Ck 


Overall 


AFOQT-l 


1.00 
















AFOQT-2 


+.62** 


1.00 














AFOQT-3 


+.34** 


+.6?** 


1.00 












AFbQT4 


+.31** 


+.19 


+ .17 


1.00. 










AFOQT-5 


+.42** 


+35** 


+.39** 


+.60++ 


1.00 








Ck Rides 


+.14 


+.08 


+.08 


+.02 


-.02 


1.00 






instrCk 


-.06 


-.07 


.00 


-.15 


-.15 


+.71** 


1.00 




Overall 


+.15 


+.10 


+.15 


+.05 


-m 


+.89** 


+.70** 


1.00 



Significant at 01 level of confidence. 



Two prediction equations were developed for each of the three T-37 phase criteria. Tlie first 
prediction equation in each set was unrestricted; i.e., predictor variables were chosen without restiaint so 
that their designation was determined solely by the mathematics of the forward selection process. The 
second prediction equation forced in the five subtests of the AFOQT and then permitted the forward 
selection process to operate freely. The complete set of six equations is reproduced in Tables E-1 through 
£-6 in Appendix E. 

Table 10 contains summary information derived from the forward selection procedure. For each 
selection condition, the multiple correlation produced and variance accounted for by the selected predictor 
variables Is listed. 

The results shown in Table 10 speak for themselves and little need be added. Obviously, the job 
sample testing approach proved successful in predicting a large portion of the student's measured 
performance in the T-37 phase of UPT. 

Cbrrdations with the hiss-Fail Criterion 

As discussed in Section II, Methods and Procedures, from the viewpoint of the training manager UPT 
students fall into two categorically distinct classes: those who pass and those who fail. To determine the 
relationships between predictor variables and this criterion, the point biserial correlation coefficient was 
computed. Although the total degrees of freedom for these correlations is 126, tables exist for 125 degrees 
of freedom and these were used. The means and standard deviations for all predictor variables are given in 
Table F-1 in Appendix F. The percentage of successful students was 55 percent; thus the pq ratio is very 
near 1 1/9, which is comfortably close to a 50-50 split. Table F-2 presents the complete correlation matrix 
obtained between the predictor variables and the criterion. 

Table 11 is a partial summary of this matrix and gives the correlations between the job sample 
predictor tests and the pass-fail criterion. Compared to the correlations shown in Table 8, these findings are 
.disappointing. Only nine of the maneuvers were significant at the .05 level of which two were significant at 
the .01 level. None of the activities correlations were significant at the .05 level. Three procedures had 
significant correlations at the .05 level. One subtest of the AFOQT was significant at the .05 level, but, 
unfortunately, with a reversed sign from that designed for UPT selection. 

As was done for the T-37 phase criteria, two prediction equations were developed for the pass-fail 
criterion. Once again the first equation was unrestricted and the second equation forced in the five subtests . 
of the AFOQT. These two equations are given in their entirety in Tables G-1 and G:2, Appendix G. 

Table 12 summarizes the results of the forward selection procedure when applied to the pass-fail 
criterion. Whfle it is true that the multiple correlations are significant at the .05 level for the five subtests of 
the AFOQT and at the .01 level when job sample instruments are included, these predictors account for 
only 9 and 20 percent of the pass-faU variance, respectively. Even the latter value would be of marginal 
utflity when applied to UPT selection. 
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\ - ' " * . Comriation 

JX^'^ Frtdtetor with * 

VarljWt niss-Fail 



Table IL Correlations with Pass*Fai Criterion 



^Maneuver 



• . 2 -.19* 

t^"-: ■ , • 3 -.20* 

•i' ■ ■ ■ . 4 -.21* 

V<, . 5 -.14 

■ • 6. -.11 ■ 

7 • . -.24** 

■ 8. ^.21* 

. - 9 • , -.20* 

■ ■ 10 -.16 • 

1 1 -.23*> 

12 -20* 

13 -.06 

14 _.17» 

15 -.07 . 

■ Activity 

I -.02 

• 2 ■ -.06 

3 -.03 

4 -.04 

5 -.08 

6 . -.13-. 

Procedure 

1 ■ .1! 

2 . .18* 

3 .19* 

4 .17* 

5 .04 

6 .02 

7 .08 

8 .15 ■ 

9 .15 

AFOQT Subtest 

1 . .16 



10 
07 
19* 

5 -.09 



3 -.07 

4 -.19* 



• Significant at the .05 level of confidence. 
•* Significant at the .01 level of confidence. 
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Table 12. Summary, of Forward Selection Results 



Stitctlon Condition 



Unrestricted Forward 
Selection 



Forced Forward 
Selection -AFOQT 

Forced Forward 
Selection.- AFOQT 



fUst-Fail Criterion 



Multiple R= .45** 
. Variance = 20 percent 
Maneuvers; 7» 1 1 
Activity: 6 
Procedure^: 2,3 
AFOQT Subtests: 1,3,4 

Multiple R= 30* 
Vanancc = 9 percent 
AFOQT Subtests: 1,2,3,4,5 

Multiple R=,45** 
Variance = 20 percent- 
Maneuver: 1 1 
Activity: 6 
Procedures: 2,3,9 
AFOQT Subtests: 1,2,3,4,5 



•'Signincjnt at .05 level of confidence 
*♦ Significant at .01 level of confidence. 



|V. DISCUSSION 

The discussion of the T40 screening study will be centered about five major topics that warrant 
further elaboration a; d clarification. These topics are: (1) the training Ly-product of the study, (2) data 
ctillection and scoring, (3) the valid predictive tasks, (4) a proposed operational program for UPT sct/»ening, 
and (5) the problem of predicting UPT attrition not attributable to flying deficiency. 

Training Accomplished 

The secondary objective of this study ,was to provide each student with a general knowledge of basic 
instrument flying skills. Althou^ the evidence that this was accomplished is subjective and anecdotal, it is 
believed that this objective was achieved. The average student participating in this study gained an 
understanding of the basic principles of flight, acquired proficiency in the manipulation of a jet aircraft 
flight control system, learned how to read and interpret aircraft instrumentation, and became familiar with 
the cockpit environment. | 

This was the student's first exposure to the military flight training system and the methods used in 
this system. To lend realism to the training situation, the student was required to strap in the trainer 
cockpit usinc a parachute harness, shoulder straps and lap belt. The student also wore his fliglit helmet and 
oxyeen mask during the sortie. All trainer instmctions were received by the student over the headphones. 

Through the use of these procedures, the program was, to a large extent, successful in accomplishing 
the desired training. In comparing the training received in the T40 screening program with that received in 
the T41 program, the most noticeable advantages of the lijiht aircraft program can be attributed to actual 
flight. The flight environment provides training in the use of external visual references essential to contact 
flying. Some indications of the candidate's ability to handle apprehension and become accustomed to fliglit 
motion may also be observed in the T41 program. 

The light aircraft program provides v^^luable training in the use of checklists, aircraft systems 
knowledge, taxiing, takeoff and landing, and contact pilotage. Both prognuns provide a basic 
understanding of the principles of flight, Tlie T-40 program furnishes the student proficiency in basic 
instrument flying skills, familiarity with the jet tPiner cockpit environment, and a feel for the control and 
power response of a jet aircraft. 
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There; are^^ this; U)pic that of conynent; fhwc are: manualdata collection^ 

Apart from human frailty in rccordmg;andVtran^^^^ data (a, process 

wh^ jtKis study )f,; the -pro^^^ that the 

. fSudc^^ .w« ?^ ^? 9Jl*V 9^ testing. &-preyiouJy ekpiained, a iogical-:m^ 

^ reBiKin^ problem.^as^^ which % early ::po^ 20 s«:ofids) of the 

- ;Sudeh^^^^^ were 'not; sco^^^ had: the; effect of not pehaliang good -studen^^^ and riot 

icwfcUng p^ In a manual system this procedure is acceptable 

csfadr n^^^ however^ a **niake:rdo** apprpaui - easily surmo^^ with 

co^^ over the trainer arids^autqnmtic data , recording antf pro^ Sudi 

' >^uipmenf ih^ 7 ^ . 

_ ]T0 The mstrunien^ asvthe unit.u^h which 

ity^m pe was Ba»5d/TTie stu^^^^ an jnd^^^^ (e.g;, straight 

aivi^le>5l:fl^ times ihrou^out the on each.attempt wis 

&orcd;%^^^ was:,use3; to determine: th^-« on tliat particular 

miheuyftt ihis/prpficie^^^^^ measure was then mea>uVes of success in,th^;T-37:.^hase 

6/41|PT: ajpproach c puld iiaye us^ :tHe .inSiyidual tests a^ the arialy ticjd unit: Whether the - 

observed ?y«^^^ would 'have increased is unknown, but siich an approach: is a viable optipri/pr future 

, research; . ' . ' ^ 

: P^P'^/^^^nt Weights. Airspeed, altitude and headmg^are depcQ^^ variables expressed in 

knots, feet ihd degrees • In addition, the magnitude oif their possible variations ranges from tens j6 hundreds 
^ndi^back to tens present study combined these/'differeni-sized a^les, oranges and pearsV by using 
tKe Z^^oJe us a homogenizing function. It would have been preferable, to have had a trkhsforrnation 
^qi^ation tp accomplLsh this, but none exists. Appropriate weightihg, factors for these three objective 
/peiforifijhae measures may need to be developed for use in UPT proficjency.assessment. 

Piedictois 

The nature of the forward selection procedure was such that it selected the most economical method 
of combining predictors to get a least squares fit. In effect, the procedure "looked at'' the entire correlation 
matrix and picked out those variables that accounted for a significant portion of the criteria with the least 
amount of overlap Between predictors. The result of this process; was to select the following maneuvers to 
be the>most valid combination of tasks in predicting T-37 phase performance scores and T-37 phase 
pass/fail T!iese maneuvers were: (l)»straight and level fli^t,.(2) pitch, control maneuvers, (3) airspeed 
changes, (4) rate climbs or descents, and (5) complex turns. 

Of the actfvities, the double light response time task was the most effective predictor. The 30° turn 
roll-out procedure was often a valuable addition to the prediction equation. 

The tasks proven effective are obviously basic instrument tasks, taught and scored early in the 
program. Good performance on these tasks require the ability to rapidly comprehend and utUize : 

'1. Instrument display information; 

2. The relationship between the instiumentdispiay and aircraft contrd; i.e.,"stay ahead of the aircraft.** 

3. « Actions and reactions to control movements; i.e., **fecl of the aircraft.? 

Simply slated, the UPT candidate with the abUity to rapidly convert verbal instruction into effective 
perceptual^notor control over the aircraft is (he most likely to succeed. 

jSopi^ Application of R^arch 

1.^ ^^^^ ^^"^'^"^ ^^^^"''^ ^^"^y ^^''^'^y of the job sample approach in predicting 

UFj^'^success but the rapidity with which essential abUities can be. identified. Such a result is extremely 
advantageous to an operational application. Examination of the training program shows that the pertinent 
mforrnatjon is gained in the initial presentations of the tasks. Most of the valid prediction information was 
obtained by the end of fifth sortie; i.e., during the first four hours of training. 
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therefore, it appears feasible to propose an operational screening package based on five 45-nimutc 
sessions. The sessions iwould be similar to the fifst five sorties in the T-40 Program Guide, but would be 
altered to.includc more testing periods of d orter duration. The fifth sortie would also include the light box 
reaction time task or some modification liercof (Sortie. 16, T-40. Program Guide). Practice on this task 
would be accomplished outside of the trainer, Appendix H is an outline of the Proposed T-40 Screening 
Program Guide. All prc-flight briefirigs, studjent activities, instructor activities, and post-flight briefings are 
identical to' those contained in the original program guide. 

P^kticm of UFT Attrition 

The -present study successfully demonstrated the utility of the job sample test as a predictor of 
student performance in the T-37 phase of UPT. On the other hand, the same variables failed to identify 
students as **non-attriiors'* or •*attritors.'' These results seem iogwally inconsistent and require further 
explanation. . ' 

It is believed that tests of ability, perse, will not succeed in predicting student attrition in the present 
UPT environment. Ability is a necesst^y ingredient in UPT, but alone, it is not s«/j?w/ir to insure 
graduation from Jhe program. Other factors - personal motivation, the training inilieu, the military image, 
etc. —have heavy, but unknu-.vn, weights in the pass-fail equation. 

V. CWCLUSIONS AND RECOMMENDATIONS 

The conclusions th»t may be drawn from the T-40 study are as follows: 

1. Job sample tests provide a valid approach for UPT screening and selection. Their validity, 
however, is limited to the prediction of student flying proficiency; such tests do not effectively discriminate 
between attriting and non-atlriting UPT candidates because the bulk of attrition results frorn factors not 
related io primary fli^t abilities. 

2. Job sanriple testing can be economically implemented: assessments of student performance can be 
accomplished within a brief period (i.e., 3 hours, 45 minutes) for personnel naive to flying. 

Two recommendations are made: 

1. Further development of the job sample test approach is warranted; this to include both test 
content and equipment. 

2. The existing selection battery is not adequate with respect to reducing UPT student attrition; 
Other dimensions of personality and behavior must be assessed. 

REFERENCES 

Cronbach, L J. Essentials of psychological testing, (3rd ed.) New York: Harper and Row 1970. 

Draper, Nil., & Smith, H. Applied regression analysis. New York: John Wiley and Sons, s966. 

Gocbri, R.A., Baum, D.R., & Ha^, W.V. Using a ground trainer in a job sample approach to predicting 
pilot performance. AFllRL-TR-71-50, AD.741 747. Williams AFB, Ariz.: Rysng Training Division, 
Air Force Human Resources Laboratory, November 1971 . 

Hinrichs, J.B. Ability correlates in learning of psychomotor tasks./aamfl/ of Applied Psychology, 1 970, 54, 
56^. 

McGrcvy, D.V., & Valentine, L.D., Jr. Validation of tw aircrew psychomotor tests. AFHRL-TR-74-4, 
AD-777 830. Lackland AFB, Tex.: Personnel Research Division, Air Force Human Resources 
laboratory, January 1974. 



Mdton» A.W. Apparatus icsis. Report No. 4, Army Air Forces Aviation Psychology Program, Research 
Reports. Washington, D.C.: United States Govcrnnwnt Printing Office, 1947. 

Miller, R.E. Development of officer selection and classification tests - 1968. AFHRL-TR-68-104, AD^i79 
989. Lackland ARB, Tex.: Air Force Human Resources Laboratory, July 1968. 

Mbsion Analysis Study Group. Mission atialysison future imder$!raduatc f)ilot training: 1975 through 1990, 
Volume 2. AFSC-TR-72-001. Test and Evaluation, USAF Mission Analysis Study Group, January. 
1972. 

Wmet^E J. Statistical principles in experimental design, (2nd ed.) New York: McCraw Hill, 1971. 



26 



APPENDIX A: T-AO PROGRAM GUIDE EXCERPTS • 
i SORTIE #4 - PREaiGHT BRIEFING 



Objectives; The student will practice previously Introduced maneuvers. 
He will: do cliiblng and descending turns, steep turns, and changes of 
airspeed in m 

Questions: 

1. Have the students label, from memory, the flight Instruments on .a 
si 101 e drawing. Draw the diagram and have him fill In the circles. 



RPM 



oo 




2. What Instrument Is the center of the crosscheck? Attitude Indicator. 

3. What Instruments will you use In your crosscheck for a change of 
airspeed In a turn to a heading? W-3, RHI, VVI, A/S, Altimeter. 

4. Can you verbalize the crosscheck for a cllntbing turn to a heading? 

'5. How do you know when you have 60"" of bank in a steep turn? By 
observing the bank pointer at the W index the second heavy mark at 
about 2 o'clock in the case. 

New Material : 

1* Change of airspeed In a turn to a heading 

In this maneuver we are combining two things you have already 
practiced., turns to headings and change of airspeed. The crosscheck 
will be about twice as busy. 



Let's look at a sampje crosscheck in this problem; You are in a 
lert tui^n from 270° (west) to US" (southeast). Yoii plin.to deci^ase 
your airspMd frpin 270K to 230K. (Use model aircraft and instrument 
^mbckrup as necessary.) 'Smoothly roll in^^^ turn using the MM^3i 
'keep the fuse.Tslgi^.dbt oh the^ h^^^ 30° of bank. . Reduce 

tfie, power. Crosscheck RPM, MM^Si W, iW-3i AUi metier i Ihiti>l 
trossdildk of thetM^^ and ^airspeed will be light^..^ As you get closer to 
.2MIC and 125°, if^uenc^^^ airsi«ed and RMI Will increase^ ngure 
lead point for rdl.lout, start power in 2-4K .above 230K. Crosscheck: 
HH^a; RMI, MH-3, Ai«pwd, »!^3, Vyi/ Alt, MH-X, etc. 

. 2.' CliMb and Descending Tunis to a He^ing^ 

Again you will be combining two maneuvers you have previously 
practiced; separately . 

-- A 

^ReneiiAer that you ^^^^ have tw lead points to fi^^^ off 
and rollout. Initially you will not crosschecic ihe RHI and altitude very 
frequently. Here is a sample crossdieck: Airspeed, HK-'S, Airspeed, 

MH-3, Altimeter, RMI, IW-3, Airspeed, Hf4-3, Alt, VVI, MM-3, RMI, MH^3^ 
Airspeed, etc. Notice that you use the VVI only to compute the level off 
1 eddpoi nt. 

3. Steep Turns 60'' of Bank 

This maneuver is. not normally done in actual instrument condi- 
tions. It is practiced to Improve the crosscheck. In a steep turn the 
rate of change in airspeed and altitude is faster. In order to keep 
deviations sirell , they must, be quickly recognized and quickly and 
accurately corrected. 

In a steep turn, lift decreases because the wings are not parallel 
to the horizon. To maintain level flight a slight pitch increase is 
necessary. The steep turn also Increases the drag. Therefore, a slight 
power increase (3-*5X RPN) is required to maintain; airspeed. 

RolV smoothly into 60"^ of bank. Keep the fuselage dot exactly on 
the horizon until you see a need. for a change on the VVI. As you pass 
45'' of bank increase back pressure. Add power as required. The cross- 
check for a steep turn Is the same as a normal turn. 
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♦ 


250K 
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1. ; Practice 
.30"? bank turns. 


increasing and decreasing A/S while performing 






lA: 






> • 








- 


. 1 ; Have the student 
' he changes his A/S. 


turn to a heading 90" 


- 120° away- while 






2. Have student complete on 360'' and 250K. 








- 




HUP 













19:00 




PREP FOR TEST - RESET TRAINER 






19:30 




REFER TO TEST 4-1 


DATA SHEET 










test 4-1 


05:00 


CHO 


15M 


360 


250K 




20:00 




60 :>econds remaining in Test 4-1 






24:00 




PREP 












24:30 


% 


START 












25:00 



mm 
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APPENDIX B: T-AO INSTRUMENT PROCEDURES EXCERPTS 



ATTITUDE INDICATOR 



The attitude Indicator provides the pilot with a substitute for 
the earth's hoplzon and a reference for maintaining desired aircraft 
attitude during all weather conditions. The attitude/indicator provides 
an 1 j^dl ate, direct »ahd cpriresponding Indka^^^^ of any change in 
aircraft pitch or bank attitude; / . f 



MM-S Attitude Indicator 

Bank . . , 

Pointer 



Horizon 
isar 



Aircraft 



Attitude 
Sphere 




eitch 
Trim Knob 



Figure B-2 




/the Tr40 simulator uses the MM-3 
attitude indicatdr. The attitude sphere 
on the >f1-3 is divided by ;a wh^ite horizon 
line; The top or "sky'Vhalf iV colored a 
light gra^y; the lower or "grdund*' half is 
black. A pitch reference scale.dndicates 
pitch angle through 9d** climb or 
These-pitch lines are gr^^^^ 
Ihtejrvals with numeHcal indications at 
30<^ and 60** of pitch, iTie wrds. XLIMB and 
DIVE are depicted.on the spher% at 15^ and 
45** of pitch. Bank attitude U ihdiM^^ 
by the posj tioh of the bank pointer Tel ati^^^ 
to the bank scale which is. marked 'With 0**, 
10**, 2a^ 30**, 60**, and 90** bM 'indices- 
The bank pointer, or "sky pointer" as it is 
sometimes called, always points towards the 
sky. It therefore points opposite to the 
direction of turn. A right turn of 25** of 
bank, as shown In figure .3, will put the 
bank pointer between the second and third 
Indices to the left. 




Figure B-3 




The pitch the aircraft requires to main- 
tain level flight largely depends on air- 
speed. You must be aware that everytime you 
change airspeed in level flight, you can also 
expect to have to readjust the attitude indi- 
cator in order to superimpose the minature 
aircraft on the horizon bar* 



An attitude warning flag will appear on 
this indicator whenever electrical power to 
the system has failed or is interrupted. The 
instrument is unreliable whenever this "off 
flag" is visible. 



Adjusting the 
Apt^tUud^ Indicator 



30 




. eecisES 

^V. - Th^?.aXr^^^ below is: 

a. 350 knots 

bi 230 knots 

^ ^ c. 250' mph- 

, " - d. 330 knots ' 

'What-iV^fe indicati^^ on the VVI below? 
' * a; .5000 fpm. climb 

■ b; 
c. 
d. 



2. 




500 fps descent 
500 fps Clint 
500 fpm climb 

/////////////////////////////////// 
d. 



3. What is the indication on the hW-3 below? 




a. 


20 


degree 


b. 


10 


degree 


c. 


20 


degree 


d. 


20 


degree 



.////////////////////////////////// 



d. 
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APPENDIX C: TEST FORMS AND SCORING EXCERPTS 

TEST 3-1 



INSTRUCTOR/'iSAN 




STUDENT/SSAN 




MTE 




TRAINER 


PERIOO 




^ Tisk 1: Reduce airspeed to 230 Kt; 
C'MM 4 - "Echo 03: Say indicated 
airspeed." 


Task 3: Increase airspeed to, 270 kt; 
Com 5 - "Echo 03: Traffic; 2 o'clock, 
4 Biles." 


Score: Heading 


Score: Conn 4 


Score: Heading 


Score: Comm 5 




Correct 0 




Correct 0 


360 


Incorrect l 


36b 


Incorrect 1 




No Re- 


360 


No Re- 




sponse 2 


360 


sponse 2 


360 






360 




360 












Task 2: Descend at 230K to 15.000 


Task 4: C1int> at 270 Kt to 16.000 


Score: Heading 


Score: Power Setting 


Score: Heading 


Score: Power Setting 




Correct 0 




Correct 0 


3^ Incorrect l 


^ Incorrect ^ 


360 




360 




360 




360 




360 




360 




360 




360 




360 




360 




360 




360 








360 
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TEST 3-1 



OPERATOR/SSAN. 
DATE 



STUDENT/SSAN 
TRAINER 



PERIOD 



XXX 



Task 1: Reduce airspeed to 230 kt; 
Com 4 

Score: Airspeed Score: Altitude 

1600 
1600 
1600 
1600 



XXX 



XXX 



XXXX 
230 



230 



Task 3: Increass airspeed to 270 kt; 
Comn 5 

Score: Airspeed Score: Altitude 



XXX luKn 


.XXX 




XXX 


1500 


XXX 


1500 


270 


1500 


jm 


1500 



Task 2: Descend at 230 Kts to 15,000 
Score: Airspeed Score: Altitude 



Task 4: Clirrb at 270 kt to 16,000 
Score: Airspeed Score: Altitude 



230 



230 



230 



230 



230 



230 



XXXX 
XXXX 
JXXX 
XXXX 
XXXX 
XXXX 
1500 
1500 





XXXX 




XXXX 


;^o 


XXXX 


270 


XXXX 


270 


XXXX 


270 


1600 


270 


1600 


270 


1600 


270 


1600 


270 


1600 



6c to instruction sheet ♦ 



!Er|c 



a8 



•INSTRUCTOR/SSAN_ 
DATE 



TEST 15 

STUDENT/SSAN_ 
TRAINER 



PERIOD 



Check trainer frozen at 16M, 360; 250K 
Check. UHF radio manual; relay taped 
commands. 

4:45 Fly straight and level 
5:00 Unfreeze trainer 
7:45 Vertical S Alpha 

Heading Climb Rate 



(313,731) 



infXl 



360 



inno 



innn 



(3689, 2457, 522) 
360 



innn 



-LOOQ. 



-360- 



1000 



(212, 3469, 522, 212, 3479) 



?60 



1000 



360 



1000 



1000 



360 



1000 



360 



1000 



-26Q_ 



1000 



(2347,421, 2349., 3458, 832) 
^60 IQQQ 



1000 



(212,2368,2679,731) 





Heading 


Climb Rate 




• ^60 


1000 






__1000 




360 


1000 




360 


. 1000 






1000 




360 


1000 




360 


1000 


24:55 


PROBLEM FREEZE 


25:45 


Fly straight and level 


25:55 


Unfreeze 


trainer 


27:45 


Vertical 


S Delta 




Bank 


CMnb Rate 


(111, 212, 421) 






-JO 


1000 




.30 


. 1000 . 




30 


1000 


(2489, 2579, 3467) 




-iO 


1000 




20 


1000 




30 


1000 
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OPERAT0R/SSAN_, 
DATE 



11:40 Check code box switch ON, press 
SET button. 



Task- 



Switches (313) 
Errors 



Time 



Switches (731) 

Errors 

INSTRUMENTS 
Airspeed 

250 
250 



Time 



Frequency (3689) 

Time 

Frequency (2457) 

Time 

Switches (522) 
Erwrs 



Time 



Airspeed 
250 
250 
250 



TEST 15 

STUDENT/SSAN_ 
TRAINER 



PERIOD 



6. Switches (212) . 
Errors Tiroe_ 

7. Frequency (3469) 
fim e . 

8. Switches (522) 
Errors Time_ 

9. Switches (212)^ 
Errors Time 



10. Frequency (3479) 

Time 

Ai rspeed 

250 
250 



250 



250 



250 



250 



11, 



Frequency (2347) 
Time 



12. Switches (421) 
Errors Time_ 

13. Frequency (2349) 
Time 



r?8 
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APPENDIX D: T-37 PHASE SUMMARY DATA 
TABLE D-1 



VARIABLE 




SAMPLE 






STANDARD 


NAME 


INDcA 


SIZE 


MEAN 


VMKlMiiLt 


nr\IT AT THM 

DEVIAIIUN 


Ml 


1 




- 1 .23 


r o OO 


T OA 

7.30 


M2 


z 




• 0.47 


yi CA 


O 0 1 

2.21 


M3 


3 




- 0.88 


OA m 


4.47 


M4 


4 




- 1 .37 


45.00 


6.75 


Mo 


0 


' ' 


3.83 


o Via 


O OQ 


Mo 


6 




-•0.34 


O Oft 

8.29 


O OO 

2.88 


h7 


7 




1 .73 


>IA 01 

40.81 


C Oft 

0.39 


MB 


o 
o 




1 .74 


1 .Ob^ 


1 on 


M9 


9 




A TO 

^ 0.7o 


i4.dU 


O OO 


MiO 


10 




A ^ "7 

- 0.37 


il ft o 

4.93 


O OO 


nil 


11 


' ' 


- 1 .37 


OO ilA 

38.40 


C OA 

O.20 


Ml 2 


12 




A r" A 

- 0.58 


o *so 

8.40 


O OA 

2.90 


r113 


13 




A A A 

0.90 


A *3A 

0.30 


A C C 

0.55 


M14 


14 




A C O 

- 0.63 


ft ft c 

9.95 


O 1 c 

3.15 


M15 


15 




A O it 

- 0.24 


1 O OO 

12.33 


O C T 

3.51 


M16 


16 




- 0.02 


O AO 

3.08 


1 .76 


Ml 7 


17 


7' 


A OA 

0.39 


A 1 C 

0.15 


A Oft 

0.39 


Ml 8 


18 


71 


0..20 


O f\ A 

0.04 


O OO 

0.20 


M19 


19 


71 


- 0.26 


62.75 


T O O 

7.92 


M20 


20 


71 


- 0.56 


C 1 AO 

6 J. 08 


O ft il 

7 94 


M21 


21 


71 


A OA 

0.39 


O To 

0.13 


A OC 

0.36 


M22 


22 


71 


A TO 

0.12 


A Cft 

0.69 


A OO 

0.83 


M23 


23 


71 


A TO 

0.18 


A Oft 

0. oU 


n Oft 


M24 


24 


71 


0.18 


O A il 

0.84 


A AO 

0.92 


M25 


. 25 




O TO 

0.19 


O 

0.75 


A OT 

0.87 


M26 


• 26 




0.03 


o on 

Q.95 


O O T 

0.97 


M27 


27 


71 


0.04 


0.90 


0.95 


M28 


28 




0.07 


O O A 

0.94 


O O T 

0.97 


M29 


29 




0.14 


0.87 


0.93 


M30 


30 




0.15 


0.85 


0.92 


AFOQT-1 


31 




70.07 


436.97 


20.90 


AFOQT-2 


32 




56.97 


703.86 


26.53 


AFOQT-3 


33 




43.25 


495.34 


22.26 


AFOQT-4 


34 




44.15 


421.12 


20.52 


AFOQT-5 


35 




59.79 


622.84 


24.96 


FLS-1 


36 




83.34 


11.24 


3.35 


FLS-2 


37 




87.77 


26.58 


5.16 


FLS-3 


38 




36.61 


2.06 


1.44 
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APPENDIX F: PASS -FAIL SUMMARY DATA 



TABLE F-1 





SAMPLE 






STANDARD 


INDEX 


SIZE 


MEAN 


VARIANCE 


DEVIATION 


1 


128 


- 0.00 


71.15 


8.44 


2 


128 


0.00 


7.90 


' 2.81 


3 


128 


- 0.00 


23.71 


4.87 


4 


128 


0.00 


51.93 


7.21 


5 


128 


4.18. 


8.03 


2.83 


6 


128 


- 0.00 


12.50 


3.53 


7 


128 


0.00 


62.56 


7.91 


8 


128 


2.01 


-2.07 


1.44 


9 


128 > 


- 0.00 


17.94 


4.24 


10 


128 ' 


- 0.00 


6.51 


2.55 


11 


128 


- 0.00 


42 .B1 


6.54 


12 


128 


0.00 


10.82 


3.29 


13 


128 


. 0.93 


0.38 


0.61 


14 


128 


- 0.00 


17.66 


4.20 


15 


128 


0.00 


16.22 


4.03 


16 


128 


- 0.00 


2.90 


1.70 


17 


128 


0.41 


0.15 


0.38 


18 


128 


0.21 


0.04 


0.21 


19 


128 


0.00 


55.71 


7.46 


20 


1Z8 


- 0.00 


68.09 


8.25 


21 


128 


0.43 


0.12 


0.35 


22 


128 


0.02 


0.97 


0.99 


23 


128 


0.01 


1.00 


1.00 


24 


128 


0.01 


1.00 


1.00 


25 


128 


0.01 


1.00 


1.00 


26 


128 


,- 0.00 


1.00 


1.00 


27 


128 


- 0.00 


1.00 


1.00 


28 


128 


0.01 


1.00 


1.00 


29 


128 


0.01 


1.00 


1.00 


30 


128 


0.01 


1.00 


1.00 


31 


128 


66.91 


473.88 


21.77 


32 


128 


54.73 


673.17 


25.95 


33 


128 


44.72 


537.3? 


23.18 


34 


128 


47.38 


374.99 


19.36 


35 


128 


61.64 


550.43 


23.46 


36 


128 


0.55 


0.25 


0.50 
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APPENDIX H: PROPOSED T-40 SCREENxNG PR0GRA11 GUIDE 



Sortie #1 




Instructional 


Task 


Elapsed 


Task 


Time 


Time 


1. Strap In 


5:0D 


2:00 


2. Yoke 


2:00 


7:00 


3. Attitude Indicator 


4:00 


11 :00 


4. Trim 


4:00 


15:00 


5» Straight .& Level 


10:00 


25:00 


6. Straight & Level (Test) 


2:00 


27:00 


7. Throttles 


5:00 


32:00 


8. Pitch Bank Power 


11:00 


43:00 


9. Straight & Level (Test) 


2:00 


45:00 
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Sortie #2 



TrlC■^lr*llr*'f•'^ nriA 1 
xilo Ul UU w 1 Uilu 1 

Task 


Task 
Time 


Elapsed 
. Time 


1. Strap-In 


2:00 


2:00 


2. Straight & Level 


10:00 


12:00 


3. Straight & Level (Test) 


2:00 


14:00 


4. Climbs Descents 


3:00 


17:00 


5. CAS Climb Descents 


10:00 


27:00 


6. Pitch Climb Descent (Test) 


2:00 


29:00 


7. Level Off 


9:00 


38:00 


8. Straight & Level (Test) 


2:00 


40:00 


Pitch Climb Descent (Test) 


2:00 


42:00 


9. Straight & Level 


1:00 


43:00 


10. CAS Climb, Level Off (Test) 


2:00 


45:00 
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Sortie #3 




x 

: Instructional 
: Task 


Task 
Time 


Elapsed 
Time 


!• 


Strap In 


2:00 


2:00 




straight & Level 


3:00 


5:00 


3. 


A/S Changes 


5:00 


10:00 


4. 


straight & Level (Test) 


2:00 


12:00 




A/S Increase uest; 


2:00 


14:00 


5. 


A/S Changes 


5:00 


19:00 


6. 


A/S Decrease Uest} 


2:0G 


21:00 




Normal Turn 


5:00 


26:00 


8. 


Turn to Heading 


10:00 


35:00 


9. 


Turn to Heading (Test) 


2:00 


38:00 




Turn to Heading (Test) 


2:00 


40:00 


10. 


CAS Climb/Descent 


2:00 


42:00 


11. 


CAS Climb Level Off (Test) 


2:00 


44:00 


• 


CAS Descent Level Off (Test) 


1:00 

• 


45; GO 
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Sortie #4 



Instructional 
Time 


Task 
Time 


Elapsed 
Time 


1. 


Strap In 


2:00 


2:00 


2. 


Straight & Level 


2:00 


4:00 


3. 


Change A/S 


3:00 


7:00 


4. 


Straight & Level (Test) 


2:00 


9:00 




Airspeed Decrease (Test) 


2:00 


11 :00 


5. 


Turn to Heading 


5:00 


16:00 


6. 


A/S Change in Turn 


5:00 


21:00 


7 


Turn f"n HPAriinn fTp^t"^ 

1 Ul II WW IICQVilll^ ^ ICOw/ 


2:00 


23:00 


8. 


Climbing/Descending Turns 


5:00 


28:00 


9. 


CAS Climb Level Off (Test) 


2:00 


31:00 




Complex Turn (Test) 


2:00 


33:00 


0. 


Rate Climb/Descent 


8:00 


41 :00 


1. 


Rate Climb/Descent (Test) 


2:00 


43:00 




Complex Turn (Test) 


2:00 


45:00 



ERIC 
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Sortie #5 

Note: Pre-flight briefing should include practice on light task 



Instructional Task ^ Elapsed 

Task Time * T ime 

■ 1. Strap In 2:00 2:00 

2. Straight & Level 2:00 4:00 

3. Airspeed Changes 5:00 9:00 

4. A/S Decrease (Test) 2:00 11:00 

5. Rate Climb, Descent 5:00 16:00 

6. Rate Climb, Descent (Test) 3:00 19:00 

7. Complex Turns 5:00 24:00 

8. Complex Turn (Test) 2:00 28:00 
Complex Turn (Test) 2:00 32:00 

9. Straight & Level 3:00 35:00 

10. Light Tasks: Straight & 

Level 4:00 39:00 

Turns 3:00 42:00 

Cas Climb 3:00 45:00 



ERIC 



